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ABSTRACT ' 

* A computerized student record system with a tes-ting 
system that allows schools to fully utilize testing data is being 
developed at Oakland Schools in Pontiac, Michigan. Test data are 
integrated with a tremendous amount of. other information. Designed 
for flexibility, up to 1200, items can be stored within a student 
record for each test administration land used to generate a wide 
variety of reports. The system* can create temporary disk files of 
student test results that can be manipulated by the Statistical 
Package for the Social Sciences (SPSS). System applications a 
district might use during a typical school year are described to 
illustrate how a comprehensive testing program can be used in a 
database environment. Examples include: (1) creating class lists 
showing student status on latest testing; (2) generating feeder 
school reports on ninth grade science final exam to find differences.* 
between junior high schools for the science curriculum committee; and 
(3) analyzing achievement test scores and generating parent profiles,, 
administrator summaries, and subtest analyses for' curriculum 
evaluation teams. New applications are being developed to further 
util'ize testing information. (BS) 
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Testfng in a Database Environment 

a* 

Ernest A, Bauer- 
Oakland Schools, Pontiac, Michigan 

Achievement testing 1s 1n the limelight. Stnce^'A Nation at^lsk," ' ' 
one commission after another has published 1'ts opinion on how to 4mprove 
schools. Nearly all of the reports have Included the recommendation that 
schools give more tests. Tests are one of the most objective measures of 
the product of the educational enterprise* Without tests, teachers and 
administrators are 1 i ke' bl 1 ndf olded dart throwers trying to improve their 
accuracy without feedback. Most schools already gi ve 1 enough tests . They 
are not, however, using tests enough, ; 

Publishers have created textbooks, tests and computer programs that 
support each other. The" programs keep track of students' progress through * 
sets of Instructional objectives by scoring and storing test, results. The 
student and class level reports are usually very Specific and provide 
teachers with nearly Immediate feedback about the achievement of each stu- * 
dent in the classroom. These systems, while providing great^hetp to the 
classroom teacher, have frequently* not been used to the extent possible 
because of their very limited capacity for aggregating across' students or 
time. * k 

At Oakland Schools, a testing system is being developed that allows 
scho^ls'io fully utilize testing data. It is; 1n fact, not a testing sys~ 
tern. It is a computorlzed student record system which includes a testing 
system. To be fully utilized, test data must be Integrated w.ith a tremen- ■ 
dous amount of other information. Which schoofs the student attended and 
will attend, and which courses the student.' took, ancl the grades he or she • 
received are a few examples of the kinds of data that must be available to 
mput the appropriate report into the hands of decision makers at the* appro- 
priate time. / ' U.». OIPARTMiNT Or IOOCATION ' "DCQUIQ^inM TO REPRODUCE THIS 
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The /Ihgle greatest feature of $.he design of the system is its" flexi- 
bility. The philosophy 1s, "1f it moves, measure \\, and store It, some- 
body will want 1t later." Up to 1200 Items may be permanently stored 
within the student record for any given test administration. What Is an 
item? A number between 0 and 9. Up to -250 scores may also.be stored for 
the same test administration. What Is a score? A number between 0 and 
999,999. The meanings of these items and scores are- entirely dependent 
upon the situation. They may be norm or criterion referenced tests. They 
may be attitude surveys. They may be recommended math class codes. They 
may even be grades. The system -creates standard reports within which in- 
dividual users -have complete flexibility to compose the contents of class 
lists, press-on labels, student profiles, and school and district summa- 
ries. It 1s able to group student test results by building, teacher 
group, test scores, sex, actual grade! current course/and section, next 

« 

school, previous school on a given date, and current school and year of 
graduation. 

TH^system also has the capablltiy to create temporary disk files of 

student test results that are, directly usable by SPSS -{the Statistical" 

Packag.e for the Social Sciences). SPSS allows users to manipulate data 

for research purposes by means of subroutines as simple as a frequency 

distribution or as complex as multivariate analysis of variance. SPSS has 

a report generating feature that allows massive amounts of data to be sum- 

marized on a' single, user-formated page. The report feature can also be 

used to list student level data. SPSS is also us£d for reliability analy- 

t 

sis of tests . -r 

It 1,s Impossible to describe a.ll of the situations 1n tfhich tests can 
be used 1n schools. . In order to convey a sense of^how a comprehensive, 
testing program can be used in a database environment, the author will de- 
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scr.lbe some of the Applications of the system a district might use during 
a typical school year.. 



September 1 



September 15 



October 1 



November 1 



-J 



\-J November 15 



December 1 



December 15 



Classes start up next week. Create class lists 
showing status on latest NRT (norm referenced test) 
and CRT (criterion referenced test^usual ly locally 
developed). New course and sections and homerooms 
and movement between elementary, middle, and high 
schools have been assigned by normal FM (file 
ma Intal nance) . 

Midwest Talent Search screening. List alpfffc by 
middle school , all 7th and 8th graders who* got a PR 
of 95 or higher 1n total reading or. total math on the 
5th grade administration of the CAT {California 
Achievement Test) . 

MEAP testing starts next weeK. ' Preslug answer shepts ' 
wit/h student numbers so MEAP results can be added to 
student dala base. 4th graders alpha by homeroom* 
7th alpha by middle school, 10th grade alpha by 
^government class . 

Career education unit starts next week. Preslug 
DAT/CPQ (Differential Aptitude Test with the Career 
Planning Questionnaire) for-all 9th graders. This 
test, after 1t is scored and reported will provide 
students an objective analysis of the match between 
their aptitudes, educational plans, and school subject 
preferences, anditheir tentative careefr choices. 

Science curriculum committee wants to see If a 
feeder school report shows any large differences 
between the junior highs on the 9th grade- science 
final exam. 

Mathematics Exit Competency Exams rfexi' ygeek. 'Preslug 
answer sheet for all students who have f\6t already 
mastered all 12 objectives', List on the answer sheet 
which objectives the student has not ' accompl 1 shed 
since he only needs to attempt those sections of the 
test- alpha by math class plus "those who are. not 
1n any math class. 

Create lists for math classes showing mastery level 
of all students 1n class whether they just took the 
test or not. Create achievement report In letter 
form to mall to parents t*f student had not already^ 
achieved mastery of all objectives. Parent report 
treats test as 12 objectives, teacher report treats 
same test as 23 objectives to help pinpoint appropriate 
Intervention. 
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January 1 . 



January 15 



Create list 'of all 12th gfacters v who. have not mastered 
all 12 objective^. These studenT^may^ffot be able to 
graduate! 

Program for 'the Gifted aiid Talented Coordinator 
wants lists of any student who earned a PR -of 9-7 
on any subtest of any test for the past 3 £ears. 



February 1 



Scheduling time at the / secondary schools. Merge 
DAT and math competency results to use for course 
selection analysis. The administrator doing the actual 
scheduling wants the 1 1 st by* recommended course. 
Counselors want the data 1 alpha by counselor. The 
Assistant Superintendent for Secondary Instruction . 
wants a> summary of recommendations by school. a"nd the 
characteristics of the typical student in each groufr. 
Use next school for grades 5 and b because theywili 
be changing schools. 

Create crosstabul atlon of DAT VR+NA; scores and 
final grades for each math course on last year's 
students to help counselors show students the 
relationship that usually exists. Remind th§m 
that 1n .all course selection problems to let student 
make the- f 1 nal *ded sion . Guidance counselors. 

Merge the CAT results T and the writing competency 
results for placement in English and remedial reading 
and composition classes. * 

List students 1n grades 4, 7, and 10 who mastered 
less than 75%'of # the objettives on MEAP.« 



March \ d Oh, God! The Board ofc Education wants to know if 

W anyone 1s really learning anything. The board member 

who 1s convinced that girls and boys are not being 
treated equally has to 'be addressed; so does the 
one who is convinced that we have the same kind of 
student population we had 15 years ago (back then, our 
- average IQ, was 118); so does the one who believes 
that new students in the district are pulling us. 
down. 

Create slides of graphs: 

1. Reading, Language, Math-ajid Aptitude PR for typical 
studerrt for last 5 years ifi entire district. 
Note that changes 1n aptitude are probably due 
to changing student body. 

2. Since matn scores have improved the least, . 
show Item analysis of 5 math Items with which , 

1 Sjtf) grade students had the' most trouble. 

3. Compare boys and girls on last year's CAT at 
grades*3, 5, and b (reading, math & language). 

•4. Compare 8th grade results for students who 

have been" in the district moce than 5 ygars, 
,■ 3-5 years and less than 3 years/ 
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5. Pertfcftt J of< students, who have mastered each 
& "of the m'aih competencies and the writing 

f competency at grades 9-12. 

6. PerGani, ; o.f students who have mastered 75% 
or-nJereV^ the*reading and math objectives 
on MEAP. at grades 4, 7, and 10 for the past 
13 years, .* \ 

The: North Central Evaluation Team is in the 
high school-, They want to know the percentfcf 
students by sex who are 3 years'below grade'level 
1n reading, 1-2 years below, at grade level, 1-2 
above, and 3 years above grade level. >Wonder how 
many years back they would like us to go? 

Time for. the annual administration of the CAT/TCS 
at grades 3, 6, and 8. Presl ug. answer sheets, as 
usual . " ^ 

Analyze CAT data for unbel ieveable results - 50 - 

PR point spread between Reading, Math or language. 

Alpha by district - include school name for each 

student. Look again for students with 25 point 

difference. List these alpha by school. - 

Correct errors a,t the individual student level without 

disturbing teacher groups or buildings. 

Analyze data for significant differences between 
aptitude and achievement using publisher's criteria. 
Include results of this analysis only on class lists. 

Generate standard parent pro'fi le and administrators' 
summaries . ' * , 

Generate item analyst of math and science subtests 
for use by curriculum evaluation and review team. 

Math competency 'test'i ng. Merge new objective mastery 
with last cummulative summary for each student. 
Create appropri-ate reports for administrators. 
Teachers get theirs next fall. 

Relief. Kids are gone for the summer. Director of 
Research and Eval uat4 on/ wants analysis of covari*ance 
on the pre-post testing designed to evaluate the new 
reading curriculum. . ' 

The science committee wants a reliability analysis 
on the new test they'piloted this spring. 

Time to load all the disks from the micros that were 
monitoring the Scott Foresman reading program into the 
data base so rescheduling only has to Be' done once and 
to get district* summary. Up-loading will also maker 
it available to use with CAT and TCs for program • 
evaluation and, placement. 
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Don't forget to run the program "that pu&s out the 
image of the student label ko counselors and teachers 
have access to all the testing data - ava i 1 able on each 
student. That's the same image .that allows electron! 
testing record transfer between .di stricts . 

August 20 . When does my vacation start? 



This scenario is intended to describe examples of' th^ types of thing 
that are already beilTg done*. New' appl icati ons are being developed almost 

• r' 

weekly. ■ - 

As the public has demanded more and more evidence about the effective-* 
ness of Schools, many haye reacted by agreeing Jto more testing. Testing 
is quality Control. Jt 1s not productions Teachers need all the time 
they can possibly 'get for teaching. 'Testing time needs to be limited to 
allow instruction to take place. When testing does occur, -however, it 
should be used. When testing is integrated with all the other information 
available In a comprehensive database envi ronment , 1t 1s available for 

4 

use. 



